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Abstract 


Cells having some properties similar to those of neurons are considered. A mass 
of such cells, randomly placed together with a uniform volume density, appears 
capable of supporting various simple forms of activity, including plane waves, 
spherical and circular waves and vortex effects. The propagation of a plane wave 
of activity has been considered in some detail. It is shown that a wave may be 
initiated in a mass of such cells by a number of individual stimuli. The mass has 
a very sensitive threshold to such stimulation. This threshold depends on cell 
properties, and by altering the threshold a mass of cells may be made to act as 
an on/off switch. The switching of waves may be compared with the shifting of 
attention in a living organism. Particularly interesting phenomena emerge if some 
property of the individual cells, e.g. size, extent of axon or dendrite structure, or 
threshold, changes with repeated use. The mass of cells may then exhibit an ability 
to modify its response according to past experience in a manner similar to that of 
living organisms. Trial and error learning, conditioned responses, and the ability 
to regenerate internally a sequence of past events may be demonstrated with very 
little complication of the form of the mass of cells. 


1. Introduction 


A marked feature of certain parts of the cortex is the apparently very large random 
factor in the distribution of neurons and in the way in which their dendrite and 
axon fibres spread amongst each other. Do some important properties or forms of 
behaviour of cortical material arise from this? It is difficult to answer the question 
unless we first know what forms of activity can exist in a random mass of neurons. 
This paper takes the preliminary step in chapter 3 of examining some forms of 
activity which may exist in a mass of cells having properties similar to the known 
properties of neurons. A résumé is given of the nature of propagation of plane 
waves. The problem has been very much formalized to make a semi-mathematical 
treatment possible, and it may be found that the structure of the mass of cells 
considered does not bear a very close relationship to any actual physiological 
structure. It is hoped, however, that the properties which such a structure appears 
to have, will be of sufficient interest for the formalized structure to be compared 
with actual neurological structure. Variations in cell properties and their effect 
upon the propagation are considered in chapter 4. Finally, chapter 5 is concerned 
with the interaction between waves and the response of a mass of cells as an integral 
part of a more complex mechanism. It will be shown that a mechanism with the 
minimum of specific organization can, on account of the presence of the mass of 
cells, exhibit behaviour surprisingly similar to certain behaviour of living organisms. 


2. The Cells 


2.1. Cells and neurons 


The tree-like dendrite and axon structure of certain neurons has been examined 
under the microscope by various workers, and some statistical data are available 
relating to the density of dendritic fibres as a function of distance from the neuron 
centre ({16]). A recent paper ({17]) has also given some statistical information 
about the distribution, at different cortical levels, of neurons with various forms of 
axon structure. The factors causing the formation of a synapse are uncertain. It 
has been suggested that either the frequency with which impulses pass through 
the respective neurons, or the occurrence of simultaneous impulses in dendrite 
and axon might tend to aid the formation of a synapse or affect its conducting 
properties, but there is little empirical evidence on this point. Nor is it known 
how the formation of a synapse is affected by the distance apart of a dendrite and 
axon, though it seems likely that proximity would aid the formation of a synapse. 
For these reasons a distinction is made between the cells considered below, which 
will be given precise properties for the purpose of calculation, and actual neurons, 
many aspects of the behaviour of which are uncertain. The cells are assumed to 
be randomly distributed with a volume density p. They comprise a density Rp of 
” sensitive cells” which have the ability to become active under conditions specified 
below, and a density (1 — R)- p of ”used cells” which are those which have recently 
been active. The ratio R is thus a function of position and time. An expression 
€(x) is used to represent the richness of connexions between cells. It is defined 
as the mean number of connexions from all the cells in an infinite plane of unit 
thickness to a single cell at a distance x. These connexions are assumed to have 
been made by a purely chance process in which the only bias is that represented 
by €(a). A value of €(a) estimated from the empirical data about neurons which 
are available is used for comparative purposes. The term ”connexion” has been 
used deliberately in place of the word synapse. This is to avoid confusion between 
the cells and actual neurons. It will, however, be assumed that the probability of 
connexion between cells, given by €(x), decreases with distance in the same manner 
that the density of connective tissue decreases in actual neurons. 


2. The Cells 


2.2. Cell properties assumed 


Excitation and time decrement 


When a sensitive cell (primary cell) becomes active it excites any other sensitive cell 
(secondary cell) to which it is connected. The initial quantity of excitation received 
by the secondary cell is proportional to the number of connexions to it from the 
active primary cell. There is thus an integration of excitation in the cells similar to 
the summation of post synaptic potential (P.S.P.) in a neuron. In a neuron the time 
decay or decrement in the summation of P.S.P. is of approximately exponential 
form, and the effective period over which integration takes place is determined by 
the exponential time constant. For the purpose of discussion the time decrement 
on the excitation of the cells will be represented by y(t). x(t) is the proportion of 
the excitation produced by a given primary cell which remains at a time, t, after 
the primary cell becomes active. It will, for simplicity, be taken to be a rectangular 
function of duration s, i.e. excitation remains effective for a period s after it arrives 
at a cell. If a secondary cell receives excitation from a number of primary active 
cells the total excitation is the sum of the increments of excitation received from 
the individual primary cells, each increment being subject to a corresponding time 
decrement. It is generally thought that one neuron can only excite another via an 
axon through a synapse to a dendrite and not in the opposite sense. In the same 
way it will be assumed here that all individual connexions are ” one way” connexions. 


Recovery time 


Immediately after activity a cell takes no further part and will be described as 
a “used” cell. It is then insensitive and excitation arriving from other cells is 
assumed to have no effect. Neurons have the property of recovering their sensitivity 
after a certain time. Cells will also be assumed to have the property of recovering 
sensitivity after a period r. 


Threshold 


Each cell is assumed to have an excitation threshold q, and it will be convenient 
to measure threshold as well as excitation in terms of a unit equal to the initial 
excitation produced at one secondary cell via one connexion from an active cell. 
This will be given the name one ” equivalent impulse” or one ”impulse”. If the 
excitation of a cell rises above threshold the cell becomes active, if it has not 
recently done so, and in turn excites other cells to which it is connected. The 
existence of a threshold is another property of actual neurons about which little 
exact information is available. There is some evidence ([7]) that the threshold of a 
neuron is of the order of 10, and while it is known that q varies, and is very high 
for a period after the neuron has been active, precise data are lacking. 
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Operating time 


A neuron has a latent period, or operating time, known as the synaptic delay. The 
cells are taken to have a constant operating time, 7, independent of the excitation. 
This is the time which elapses between the excitation reaching the threshold level 
and the cell becoming active. The period 7 is also taken as the unit of time in 
calculations. A given cell is only capable of exciting other cells connected to it at 
the instant it becomes active, or to put it another way, it has been found convenient 
to incorporate the length of the period of activity in the form of y(t). 


2.3. Neuron properties for comparison 


Here and there it has been of interest for comparison to insert numerical data 
corresponding roughly to actual neurons. 
The following values have been used: 


Synaptic delay time 7 = 0.5 ms. 
Integrating time constant s = 4ms (corresponding to time decrement). 
Recovery period, r = 10 ms to 100 ms. 


It has been difficult to arrive at suitable numerical data for (x) because of the 
lack of information on the necessary conditions for the formation of a synapse. To 
obtain any values at all it has been necessary to make several assumptions, i.e. 


1. The axon and dendrite structure is predetermined statistically and entirely 
by factors within the cell, i.e. there is no tendency for axons and dendrites 
to grow towards each other. 


2. A synapse is formed automatically between the axon of one neuron and the 
dendrite of another if the two fibres happen to lie within a given distance 
(say 1pm) of each other. 


3. The density of the dendrite fibre structure is taken to have the form c- % -e% , 
where a is the distance from the perikaryon, c and ag being constants. The 
expression is derived from results published by Sholl ([16]). 


4. The axon structure is relatively compact. 


If these assumptions are justified then, using the method described by Uttley ((20]), 
it may be shown that €(x) has the form 


|x| 


b-e %, 
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where b is a constant the magnitude of which depends on the density of the axon 
and dendrite structures and on the exact conditions (see item 2 above) governing 
the formation of a synapse between neighbouring axons and dendrites. If the axon 
structure is not compact but is similar to the dendrite structure, the form of €(zx) 
is modified slightly, and the number of connexions falls off slightly less rapidly with 
distance. 

In this expression the value of b is rather uncertain, for even if the above assumptions 
are justified the exact separation of axon and dendrite at which a synapse will 
form is not known. The constant 6 is also proportional to the total length of an 
axon fibre which varies considerably between different types of neurons. If the 
critical separation were equal to 1 jm for example, b might vary from 0.6 in units 
of 1/1 pm for average neurons to 4.2 in the same units for neurons with particularly 
long axons. The constant ao derived from Sholl’s data is about 50 pm. 

It may be noted that although a volume density of cells has been mentioned above, 
the following calculations would apply equally well to a plane density of cells 
provided a suitably modified form of €(2) was employed. 
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When we come to consider the activity which may occur in a large mass of cells of 
the type that has been described, we have a state of affairs that at first appears very 
complex. Each cell when it becomes active may excite many of its neighbours, and 
not only immediate neighbours but also some which are separated by a considerable 
length of connecting fibre. Each cell will be different from any other in the way in 
which it scatters excitation to other cells. The only common factor is the probability 
of connexion between any cell and others at a given distance from it which, for 
convenience in later calculation, has been given in the form of €(x). The situation 
appears to be further complicated by the fact that the excitation arriving from 
one cell is only effective if the excitation from other cells arrives within a short 
interval s, before or after, so as to cause the integrated excitation at a sensitive 
receptor cell to exceed the threshold. The spread of activity is thus essentially of a 
co-operative nature. 
In spite of the apparent complexity which has just been stressed, it is possible 
by treating the activity statistically to simplify the examination of certain forms 
of activity. Thus, we shall consider not the activity of any individual cell, but 
only the proportion of cells becoming active in any region per unit time. This 
will be denoted F(z, y, z,t), since it is a function of position and time, and will 
be abbreviated to ” activity” or ”F”. In all the following calculations we shall be 
considering only the variation of this statistical ” activity” in the x direction, F 
being invariant in any given y, z plane. This being so, F(z, y, z,t) may be written 
F(a,t). F(a,t)-€(a — X)dX will thus be the mean rate of arrival of impulses at 
single secondary cells in the plane x from cells becoming active at a mean rate F’ 
within a plane of thickness dX at X. 
The convolution 7 

/ F(X,t)-€(a@ — X)dxX 
therefore gives, in terms of x and t, the mean rate of arrival of impulses at cells in 
the plane x from all other cells. 
The convolution 


N(c, t) -[ [O FeD-@-x)-xt-Taxar 


similarly gives the mean value of integrated excitation, N, for cells in the plane zx. 
These are the two basic expressions on which the analysis of specific forms of 
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activity will be based. From the mean integrated excitation, N, given by the 
second expression, and from a knowledge of the proportion R of cells which are 
sensitive, we can calculate the proportion of cells which have an integrated excitation 
of (q—1) and are also sensitive. These are the cells which are ready to be triggered 
into activity by the arrival of one further impulse. How many of these cells do, in 
fact, receive this additional impulse during a short period dt will depend on the 
mean rate of arrival of impulses, given by the first expression above. Thus we may 
calculate the proportion of cells which may be expected to become active after an 
interval equal to the operating time 7. This is the new value of the activity F’. 
Two specific forms of activity will be analysed, continuous random activity and 
the propagation of plane waves of activity. 


3.1. Continuous random activity 


What would happen if initially, throughout a volume of cells, the activity F’ was 
constant and independent of x, and what are the necessary conditions for this 
activity to be self-maintaining? These questions are here discussed qualitatively, 
but the same arguments are followed analytically in the Appendix A. 

As the activity is assumed to be constant throughout, the expressions for mean rate 
of arrival of impulses and mean integrated excitation are much simplified, as they 
are independent of «. We are left with a simple, though non-linear, relationship 
between the activity F(t) at any instant, and the consequent activity F'(t+7) after 
an interval 7. Owing to the non-linearity of the relationship (see Appendix A) 
there is only one value of F(t) for which F'(t+7) = F(t). If the activity is lower 
than this critical value, F(t +7) will be even lower, and F’ will go on decreasing 
during successive intervals of 7 until all activity finally ceases. If F(t) is above the 
critical value, F(t + 7) will be higher than F(t) and so on, the activity increasing 
rapidly until it ” burns itself out” by using up all the sensitive cells before any have 
a chance to recover. 

For equilibrium, two conditions must be fulfilled. The first is that the value of F 
must be equal to the critical value. The second is that there must be a balance 
between the cells which are excited to activity per unit time, and the cells which 
are recovering their sensitivity after previous activity. Only for certain values of 
the parameters €(x), q, etc., which represent the primary cell properties, can these 
two conditions be fulfilled. In particular, the higher the value of qg, the greater is 
the degree of connectivity required to make equilibrium possible. Unfortunately, 
the empirical data at present available are too inexact for it to be possible to say 
whether an equilibrium condition of continuous random activity can or cannot exist. 
One can, however, be certain that there could at most be an unstable equilibrium, 
because any small local statistical variation in, say, connectivity would initiate a 
rapid rise or fall of F', away from the equilibrium level of activity. Thus, even if 
one starts with uniform activity, one may soon find that the activity has died away 
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in some places and has flared up in others. It is for this reason that activity with 
some form of spatial and temporal organization will always be favoured if q is above 
unity. Such activity, though it may ”burn itself out” by using too many of the 
sensitive cells in one region, can then move on to another region where sufficient 
sensitive cells remain, perhaps to return when the used cells recover. Plane waves 
are an example of activity with spatial and temporal organization and, as they are 
of considerable interest, the rest of this section will be devoted to discussing their 
propagation through a mass of cells. 


3.2. Plane waves of activity 


The propagation of plane waves through a medium of the type we are considering 
is different from the propagation of more familiar types of waves, for example, 
electromagnetic or acoustic waves, through linear media. The properties of the 
mass of cells are changed temporarily by the passage of activity, inasmuch as some 
of the cells are changed from the ” sensitive” state to the ”used” state so that the 
effective cell density is reduced. The result is that instead of a continuous wave 
motion we get a transient peak of activity travelling through the medium, followed 
by a relatively quiescent period. The mechanism of the propagation of such a wave 
will now be examined in more detail. The discussion will be qualitative but is 
paralleled by an algebraic analysis in Appendix B and Appendix C of the Appendix. 


Activity and density of sensitive cells 


Suppose we have a homogeneous mass of cells in which there has been no recent 
activity. All the cells will be in the sensitive state, and if we plot the density of 
sensitive cells against distance, x, we shall have a straight line parallel to the axis 
(curve i, Figure 3.1a). 

Suppose now that a wave of activity of constant amplitude, such as that shown 
in Figure 3.1b, is travelling from left to right in the x direction. This travelling 
wave will have converted some of the sensitive cells, in the region through which it 
has passed, to the used state. Thus both parameters, F’ and R, are now variables. 
When the peak of activity has reached the point designated x, in Figure 3.1b, the 
distribution of sensitive cells as a function of x will be of the form shown in curve 
ii of Figure 3.la. There will thus be less sensitive cells in the region through which 
the wave has passed than in the region through which it has yet to pass. This 
asymmetry means that the region in front is better able to support further activity, 
and this, as we shall see, is why the wave continues to propagate in a forward 
direction. 
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Figure 3.1.: Spatial distribution of various parameters associated with a travelling 
wave of activity. R, proportion of sensitive cells remaining when peak of wave has 
reached 2x1; F,, activity; N, mean integrated excitation; ®, proportion of sensitive 
cells which attains threshold per unit time; R®, new distribution of activity after a 
time T 
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Activity and excitation 


The wave of activity consists of the activation of a large number of individual 
cells, each of which scatters excitation among its neighbours through the randomly 
distributed connective structure. Cells in the neighbourhood of the peak of activity 
will be excited to various levels, the mean level of excitation being highest at the 
peak. A plot of the mean level of excitation (see curve of N Figure 3.1c) will 
be rather broader than the curve representing the distribution of activity, the 
actual breadth and shape depending on the exact form of (2). Some of these 
neighbouring cells, especially those near the peak of activity where the mean level 
of excitation is high, will be excited above the threshold level of excitation gq. A 
plot of the probability of this happening, as a function of x (® in Figure 3.1c) 
will thus be narrower than the plot of N. Only cells which are in the sensitive 
state will be triggered into activity when their excitation exceeds the threshold. 
To find the rate at which cells are about to become active at any point we must 
therefore multiply the distribution ® of Figure 3.1c by the distribution of sensitive 
cells (R, curve ii in Figure 3.1a). The product is yet another peaked curve, but is 
shifted forward along the x axis by a small distance (Figure 3.1d). Thus, although 
excitation spreads out in all directions from the peak of activity, a greater number 
of new cells is excited to activity ahead of the peak than in the region through 
which it has just passed. This is the mechanism by which the advance of the wave 
is maintained. 


3.3. Waveforms — dependence on €() 


Little mention has been made so far of the dependence of the waveform on €(z) 
and other cell parameters. If we take a form of €(2) based on empirical data 
at present available, the waveforms are those illustrated in Figure 3.1. The 
corresponding analytical expressions, if the amplitude of the wave is small (see 
Appendix, Appendix C), are: 


R=1-5M—5M-tann{p-(+-*)}, 


eS aida 
~ 2-cosh? {8-(t-2)}? 


where M is the proportion of cells used during the passage of the wave, for 
convenience called the amplitude” of the wave. The parameter 3, which one might 
call a propagation constant, and the velocity v are, as one might expect, principally 
dependent on €(x) and on the integration time s and the threshold g. The wave 
shape also depends primarily on the form of €(a) (see Appendix, Appendix C). 

If the amplitude of the wave is large, so that the mean integrated excitation N at 
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the peak of activity is high, the waveform is modified slightly. These modifications 
are shown in Figure 3.2. 


3.4. Attenuation and gain in amplitude 


Owing to the non-linear nature of the threshold effect, there is a critical amplitude 
of wave which produces just enough excitation to maintain the level of activity 
in the wave constant. This critical amplitude will be called Mo. If the initial 
amplitude M of the wave is less than Mo, then the wave will either be attenuated 
(Figure 3.3, curves a and b) or will increase in amplitude until it ”saturates”, when 
it uses all the cells in the medium through which it passes, and the amplitude 
cannot increase further (Figure 3.3, curves c, d and e). 


Saturated and unsaturated waves 


As the wave approaches the saturated form it becomes much broader with a slight 
asymmetrical change in form. There is also a considerable increase in velocity. 
The saturated waveform is shown in Figure 3.2, for comparison with the other 
waveforms. 

It is important to note that two unsaturated waves may have the same values of V/, 
G8 and v and yet may not be identical. This is because they may activate different 
cells as they pass, or may activate the same cells in a different order. If / is small 
there are a very large number of constitutionally different waves described by the 


same statistical formula 
MB 


2 - cosh? {B- (é- z)} 
Unsaturated waves, for which M is less than unity, inherently carry with them 
more information, in terms of the identity of the individual cells activated, than 
can saturated waves which activate all cells. They will be of primary interest later 
in this paper. 


3.5. Other forms of activity allied to plane waves 


The above calculations only apply to plane waves of infinite extent in an infinite 
volume of cells, but similar calculations may be made with regard to the propaga- 
tion of linear waves in a thin sheet of cells or neurons, provided a suitably modified 
form of the parameter €(zx) is used. In practice the calculations may also be applied 
to any wave which approximates to a plane wave over an area large compared with 
az, or which approximates to a linear wave over a range of distance large compared 
with ag. Thus the calculations will apply to spherical or circular waves of radius 
of curvature large compared with ao, since these waves approximate to plane or 
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Figure 3.2.: Waveforms. The full-line curves give waveforms for maximum values 
of N = 5,3 and i The dotted line gives the saturated waveform. The broken 
curves give cosh™ (Ee. x) for z= = 10pm and 6 = 12.58". The peaks of all curves 
have been adjusted to comedes in height on an arbitrary ordinate scale 
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Figure 3.3.: Dependence of attenuation and gain on amplitude. Mo, critical 
amplitude; M,, saturation value = unity 


linear waves over a limited region. 

The same considerations regarding critical amplitude, attenuation or gain, and 
saturated waves will apply to such waves, but the calculations will not apply 
strictly at small radii where the distribution of activity will be modified due to the 
curvature of the wave. The effect of the curvature in a converging wave will be 
similar to the effect of an increase in amplitude of the wave or an increase in the 
density of connexions, while in a diverging wave the effect will be reversed. The 
focus of converging unsaturated spherical or circular waves can in this way become 
a source of further waves. 


Effect of recovery of cells 


One property of neurons which has not been considered fully yet is the recovery 
of sensitivity after a period of time. One reason for avoiding discussion of this 
point is that neurons appear to regain their sensitivity gradually after activity, 
and different sources of information give considerably different rates of recovery. 
However, whatever form the recovery of sensitivity follows, it is evident that it 
will facilitate the propagation of subsequent waves in a region through which one 
wave has already passed. In fact, fully saturated waves may follow each other at 
intervals equal to the period taken by the cells to recover sensitivity completely, 
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and unsaturated waves may follow even closer. This makes it possible for a wave 
to pass through a region, and return again to the same region some time later 
when the majority of the cells have recovered. This would allow a relatively local 
circulation of activity which might be of some importance. 


3.6. Discussion 


Various physiological investigators have stressed the difficulty of deciding what 
forms of co-operative activity might exist within the cortex and what the function of 
such activity might be. It has been commented that there are an almost unlimited 
number of neuron chains interlinked and superimposed and that activity may 
pass round all these chains simultaneously, each affecting its neighbours in the 
process. This leaves one with the impression of a mass of cells the behaviour of 
which would be almost impossibly complex for analysis. McCulloch & Pitts ({11]) 
consider some forms of activity within circular paths. The subject is treated rather 
abstractly from the point of view of logical analogy and the circuits themselves 
are not considered in detail. Other workers (Rapoport [12], [13]; Shimbel [14], {15]) 
have tended to the opposite extreme and have considered only the activity of small 
sets of two or three, or groups (ganglia) of neurons without considering the effect 
of their spatial distribution. Their conclusions are therefore not directly applicable 
to large masses of cells. The aim of this part of the present paper has been to show 
that large masses of randomly distributed neurons may support certain relatively 
simple, well-defined forms of activity, in particular plane waves and certain allied 
types of activity such as spherical or cylindrical waves (in a volume of material), 
circular waves (in a two-dimensional sheet of neurons), and circulatory effects (the 
exact form of which depends on the shape of the mass of cells and on their initial 
state). 

Other forms of activity may also exist, but unless the cell threshold is low, the 
activity must have some form of organization. In any case, activity with some form 
of organization will be favoured if the threshold is above unity. It is, in fact, the 
existence of a threshold above unity which is primarily responsible for the forms 
of activity enumerated above, all of which are essentially of a co-operative nature. 
The non-linear nature of wave propagation consequent on a threshold exceeding 
unity is an important factor in the behaviour which will be discussed in chapter 4 
and chapter 5. 
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4. Some Elementary Properties of a 
Mass of Cells 


In the following sections a number of simple effects are considered: the launching 
of a wave and the representation by it of the launching stimulus, the switching 
function of a mass of cells, the stabilization of the amplitude of a wave, etc. Without 
the possession of properties additional to those outlined in chapter 2, the cells in 
the mass would have no ability to store information permanently nor could the 
mass modify its response on a long-term basis according to past history. It will 
be shown in section 4.5 that a mass of cells would have the ability to modify its 
response if some cell property changed with repeated use. This prepares the way 
for consideration in chapter 5 of the response of a mass of cells as an integral part 
of a more complex mechanism in which it exhibits such behaviour as learning, 
conditioned response reactions, etc. The mass may thus be shown to produce, in a 
suitable environment, some forms of behaviour regarded as characteristic of living 
organisms. 


4.1. The reaction to activation of a number of 
individual cells on one surface of the mass 


It will be convenient to consider first the initiation of a wave at a hypothetical 
boundary where the cell density decreases gradually from one side to the other 
according to the law 


1 1 
p= pe (1 5Mo— 5Mo tanh (%-2) ) 
2 2 v 


as shown in Figure 4.1a and b. This corresponds to the distribution of sensitive cells 
when a wave is travelling through a continuous mass. Suppose we now stimulate 
the mass by activating, over a period s, a proportion of cells having a distribution 
about the boundary given by the expression 
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(see Figure 4.1c). 
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We now have a state of affairs exactly corresponding to a wave travelling through 
a continuous mass and, as we have already seen, it will continue to propagate with 
a velocity, v, in the x direction. 

The critical stimulus which it is necessary to apply in the region of the boundary 
plane may be expressed as a surface density Do, in which case 
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If a stimulation less than this is applied, the wave produced will have a value of 
M less than Mp and will attenuate. A stimulation greater than Dp will produce a 
wave with M greater than Mo which will rapidly increase in amplitude. 

If there is no boundary and the medium is continuous on both sides of the plane 
x = 0, then waves will travel in both directions. These waves will initially reinforce 
each other, so a rather smaller value of Do will be required to initiate waves with 
M = Mp, ie. 


2408 
Do = const. - Mo Gp - ey where const. <1. 
qd 


If instead of a diffuse boundary there is an abrupt boundary with no cells at all 
available to the left of the plane x = 0, then the wave which is launched will lack 
reinforcement by the activity of these cells but will have extra support from the 
additional cells to the right so that we may write 


2a9s 
Do = const. - Mo Gp - cea where const. ¥ 1. 
qd 


Minimum stimulus and switch effect 


Whatever the form of the boundary there is a density of stimulation, Dp, which 
will initiate a wave or waves with the critical value of MM which has been called Mo. 
A stimulation less than Dg applied to the mass will produce an effect which will 
die out quickly, but a stimulation greater than Dp will produce a wave which will 
quickly rise to saturation. 

If we call the plane of stimulation G (Figure 4.2) and consider the activity in a 
parallel plane H sufficiently far away, we shall find a saturated wave at H for 
inputs greater than Do and zero activity at H for an input less than Do. Thus a 
mass of cells acts as an amplitude-sensitive switch with a very sensitive threshold Dp. 
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Figure 4.1.: Distribution of cell density and stimulation at diffuse boundary. For 


explanation see text 
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Dependence of constitution on spatial and temporal pattern of stimulus 


It should be noted that though waves arriving at plane H may all have a similar 
general form the constitution of each wave will depend on the identity of the 
individual cells originally activated in plane G. Moreover, if cells are activated not 
only in plane G but at various points between G and H, the constitution of the 
resultant wave will depend on the sequence in which these cells are activated as 
well as on the identity of the cells. The constitution of the wave thus represents 
the stimulus which initiated it. 


Limited area of stimulation 


If adequate stimulation (D >> Dg) is applied only over a limited part of the plane 
G, then a plane wave over the limited area will result. There will be more or less 
fringing at the edges depending on the actual value of D (Figure 4.2a). 

Waves may arise from quite a small area of stimulation. The fringing effects will 
then be more important and a relatively high value of D will be required to initiate 
the wave. The result will be a spherical rather than a plane wave (Figure 4.2b). It 
is possible that this form of wave is of more practical importance than the true 
plane wave. The propagation will be very similar when the radius of curvature is 
well above ao, because any small section of the spherical wave will behave like a 
plane wave. 


4.2. The effect of slight alterations of threshold 
either of cells in general or of particular groups 
of cells 


Consider first a wave having the critical value of M. In general, this will continue 
to propagate with constant amplitude, although in the end statistical fluctuations 
may increase its M above or decrease its MM below the critical value of M. When 
this happens the amplitude of the wave will either continue to increase until it 
reaches saturation or decrease until it ceases to exist. 

If, however, the value of threshold, q, is raised even slightly, then the value of Mo is 
also raised and the wave having a value of M corresponding to the original Mo will 
now attenuate rapidly. If q is reduced to slightly below its original value, then a 
similar wave will gain rapidly in amplitude until it saturates. Thus if a wave with 
M equal to Mp is launched into a mass of cells it may be made to attenuate or gain 
in amplitude by slightly altering g. For example, alteration of gq from 10 to 10.1 or 
9.9 would cause a wave to saturate or to disappear within a period of about 107. 
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Figure 4.2.: Waves arising from a limited area of stimulation 
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Figure 4.3.: E cells 
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Sub-threshold excitation 


One way of altering the effective value of g without altering the inherent threshold 
of cells is to supply them with a small amount of excitation from some external 
source immediately before or during the passage of a wave. Suppose one has, 
external to the mass, a group of cells whose axons penetrate the mass and ramify 
randomly within it (F in Figure 4.3). 

If these E cells are activated periodically then the cells within the mass will 
regularly receive excitation from the axons of the E cells. The mean excitation 
received per cell in this way may be calculated from €(x). If Fe is the mean rate of 
activation of external cells expressed as a proportion of the total number of cells 
within the region of the mass into which their axons penetrate then the mean rate 
of excitation will be 

+00 


N per unit time = F, - , E(x) dx 


—oo 


= F’.bag 7 
and, if the integrating time constant is s, the mean integrated excitation will be 
N = F.sbao. 


Now if N is small compared with q, say not more than 1, the proportion of cells 
stimulated above threshold during a period s will be very small (approx. 10~7 if NV 
is 1). The excitation from these external cells will thus not itself initiate a wave, 
i.e. it will be ’sub-threshold” stimulation. Nor will it ”use up” sufficient cells in 
the mass to affect propagation appreciably. It will, however, decrease the effective 
mean value of q throughout the block from gq to (¢ — N) which will very radically 
affect the propagation of any wave across the block. 

The external cells postulated above thus give a very sensitive control of the prop- 
agation of a wave through the block. They form, in fact, a means whereby a 
wave entering the block with the critical value of Mp can be switched on or off by 
external means. For convenience of reference the external cells will be labelled E 
in any diagram below and their axons will be called the EF input to the block. 


Organization 


It may be noted that the introduction of the FE cells and their axons is the first 
form of organization which has been postulated in the arrangement of cells in the 
mass. All the other cells have been taken as randomly distributed and their axon 
and dendrite structures have been assumed to be independent of their position. 
The structure of the F cells can be described by fairly simple statistical laws, but 
these are evidently different from those assumed heretofore for cells within the 
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Figure 4.4.: I cells 


mass. The same applies to a set of cells with specialized dendrites which will be 
considered in section 4.3. 


4.3. The effect of small variations in cell density 


The value of Mo, the critical value of M for a block of cells, depends on the cell 
density p, as well as on the value of q. If p is increased then Mp decreases and vice 
versa. Thus if there is some means of removing, or ”using up” a small proportion 
of the cells in the medium before the passage of a wave the propagation of the 
wave may be affected in the same way as if gq had been increased. 


Sub-threshold activation 


Suppose one has external access to a group of dendrites connected to a proportion 
of the cells scattered randomly in the mass (J in Figure 4.4). By means of the 
dendrites these J cells may be excited strongly so as to render them active, after 
which they will be ”used” cells and will remain in the latter condition taking no 
further part until the end of the recovery period r. It is essential that the J cells 
should be excited to activity. If they were merely given a weak excitation an effect 
similar to that of the E input would be produced. 


The effective reduction in p can be calculated as follows. 

Let F; be the rate at which cells are rendered active by means of external dendrites, 
expressed as a proportion of the total number of cells within the region of the mass 
concerned. Then Fjr will be the mean proportion of cells in the ”used but not yet 
recovered” condition. Thus (1 — Fr) will be the effective cell density encountered 
by a wave propagating through the medium. 


28 


4. Some Elementary Properties of a Mass of Cells 


travelling wave 


Figure 4.5.: Basis of possible servomechanism to stabilize 


In calculating the change in Mo, account must be taken of the mean decrease in 
effective q caused in other cells by excitation received from the I cells rendered 
active by means of the J dendrites. This will be F;sbag (see section 4.2). Provided 
F,sbag is small compared with q, this excitation will be insufficient to initiate a 


wave (section 4.2), but it will affect the value of Mo. For small variations, Mo is 
sbag 


diseEts 
approximately proportional to /2 . This fraction is increased in the ratio =>=--, 


so that if r > 222, there will be an increase in Mp when both effects are taken into 
account. If we take the comparative values for actual neurons of chapter 2, we find 
that in fact r > 2220. 

The external dendrites postulated above thus give a very sensitive control of the 
propagation of a wave through a mass of cells. But stimulation of these dendrites 
increases the attenuation of the wave instead of decreasing it as did the stimulation 
of the E cells considered in section 4.2, i.e. the effect is inhibitory rather than 
excitatory. Apart from this, the effects are rather similar. For convenience of 
reference these external dendrites will be called the J input to the block. 


Timing 


It may be noted that the effects described above of EF and J cells are dependent 
on the rate of activation of these cells being constant and continuous. If the cells 
were activated intermittently both the E and the J input could produce either 
an excitatory or an inhibitory effect on a wave dependent on the timing of the 
activation in relation to the passage of the wave. This dependence on timing is 
made use of in the mechanism discussed in the next paragraph. 


Stabilization of the value of M 
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The parameter MM is inherently an unstable factor when it has any value other than 
zero or M,. It is in unstable equilibrium when it has the value Mo, and any slight 
increase or decrease in value due to some statistical fluctuation in density of cells 
or connexions will start a rapid rise or fall away from Mo. 

There are a number of properties of unsaturated waves passing through a mass of 
cells which only arise if the value M is rendered stable by some means. None of 
these properties is shown if all cells in the medium are activated by a saturated 
wave travelling through it. As these properties are in many respects analogous to 
the behaviour of living organisms, it seems worth considering whether this stability 
could easily arise. It is possible to conceive a servo-mechanism working somewhat 
along the lines indicated in Figure 4.5, which might provide the necessary stability. 
The axons P arise from the cells scattered at random within the mass. Only those 
which have just been activated by a wave travelling through are shown. The cells 
Q are activated if sufficient impulses are received from the P axons and which in 
turn excite J input fibres a short distance ahead of the wave. Again only those 
in action at one instant are shown. The P cells thus monitor the activity of the 
travelling wave, and if this rises high the Q cells, and in turn the J cells, will be 
activated so that the effective cell density is reduced in the path of the advancing 
wave, so attenuating it. The activity in the wave is thus controlled by servo action. 
Because of the threshold effect in the Q cells a small variation in activity would 
produce a large change in the number of J cells activated. 

It is possible that some servo action could occur in other ways without any external 
cells or connexions by the agency of some inhibitory or depressive effect. On the 
other hand, it is interesting to note the similarity between the structure of Figure 4.5 
and the structure associated with masses of neurons in the cortex as reported by 
various investigators (Lorente de N6é, [10]). The action of any servo-mechanism 
and its relation to the mass of cells might well be very complex and is a subject 
which merits detailed study. 


Interchangeability of E and I cells 


The effects of E and J cells are in a way complementary, in that reduction of 
the excitation of one set produces a similar effect to an increase of excitation of 
the other. Thus for most purposes they are interchangeable and a group of one 
type of cell can be replaced by the other type provided a suitable modification is 
introduced in the manner in which they are excited. 


4.4. The reduction of a wave to a single output 


Suppose a wave with M equal to the critical value Mj reaches a boundary J, at 
which some property of the cells (e.g. density p, ao, g, etc.) changes in such a way 
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Figure 4.6.: Plane T is separated from plane J by the critical attenuating length 


that Mo is increased. Beyond the boundary, M for the wave will be less than the 
new value of My and the wave will attenuate. At some point beyond the boundary, 
the wave will be reduced to the activation of one single cell. 


The distance between the boundary J and this point will be subject to a slight 
statistical variation between waves of different constitution, but the mean value 
will be described as the critical attenuating length. Let us now terminate the 
mass of cells at a plane JT parallel to plane J and separated from it by the critical 
attenuating length (Figure 4.6). Then a wave with M = Mp before the boundary 
T will, on the average, just reach the plane 7’. If any wave fails to activate even 
one cell in the neighbourhood of the plane 7 a very slight increase of M in the 
wave as it approaches the boundary J will suffice to make it do so. Any further 
increase in M would produce many active cells in the neighbourhood of T.. We 
could, of course, define a wave as having a value of WM above or below Mp according 
to whether it activated more or less than one cell in plane 7’, and for the purpose 
of discussion this is probably most convenient. 

Suppose that in the above manner each wave is made to activate one cell when it 
reaches T’ (Figure 4.7). Different waves will in general activate different cells, but 
a wave of a given constitution arising from a given set of cells activated in plane G 
will always activate the same cell in plane T (unless some change has been made 
in the cells within the mass). 

The constitution of the wave and therefore also the identity of the set of cells 
originally activated in plane G are thus classified in terms of the single cell finally 
activated in plane 7’. However, the number of different sets which may be activated 
in plane G will far exceed the number of cells in plane 7’ so that the classification 
will either be incomplete or ambiguous. It is also true that living organisms are 
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Figure 4.7.: Successive wavefronts in an attenuating medium eventually dwindle 
to the activation of a single cell in plane T’ 


unable to distinguish completely and unambiguously all possible patterns of stimuli 
applied to their sensory receptors. 


4.5. The result of making threshold or growth 
dependent on activity 


Composite mass 


So far, the wave produced by activating a number of individual cells, and the 
behaviour of the wave at various boundaries designated G, H, J, and T,, have been 
considered. The properties of a composite mass G, H, J, T (Figure 4.8a) will now 
be investigated, the boundaries G, H, J, and T having the same significance as 
before. 

It will be assumed that the value of M of a wave initiated at G is controlled in 
section GH by servo action. When it enters the section HJ the wave will be 
assumed to have a value of M equal to Mo (Figure 4.8b). It will then continue 
without change to J. Between J and 7, M will be reduced progressively until 
finally one cell is activated in the plane 7. The identity of the cell activated in 
plane T' will of course depend on the constitution of the wave which reaches J, 
so that in the plane T there will be a form of classification of the constitution of 
waves arriving at J. 

We shall mainly be concerned with the effect of varying the properties of groups of 
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Figure 4.8.: a, Composite mass of cells; b, the variation of M between the 
boundaries G, H, J and T 


cells in the central section HJ of the composite region G, H, J, T. It simplifies 
demonstration of the properties of the mass of cells in this section if we have to 
deal only with waves with a fixed value of M entering it, and if between J and 
T the constitution of the wave can be reduced to the activation of a single cell 
in plane T. The properties which will be discussed are, however, inherent in the 
nature of the material (i.e. a mass of cells) of which the region is composed, and 
not due to the division of the material into sections. Various shapes of cell masses 
and arrangements of them in sections would show similar properties. 


Threshold or growth and activity 


If the threshold of the individual cells within the section H, J decreases with 
frequent use, then the mass of cells within this section will have the ability to store 
information permanently and will modify its behaviour permanently according to 
past history. It will be shown that there is a very interesting parallel between these 
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phenomena and certain forms of behaviour of living organism. No such phenomena 
arise unless the cells possess some additional property or properties of this type 
and My < 1. This relationship will be assumed from now on. This assumption 
is in accordance with the histological data available, provided the effective axon 
length is several hundred microns in length. 
The suggestion that the threshold of a neuron might be lowered by frequent use 
has been put forward as a possible explanation of the simple conditioned response, 
and is supported by some experimental evidence (Eccles & McIntyre [8]; Eccles |7]). 
It is appropriate to consider the influence of such an attribute on the propagation 
of the waves. Similar effects could arise in other ways, for example, if growth of the 
dendrite and/or axon structure was promoted by activation of a neuron or if the 
formation of synapses was aided by activation. Growth of either structure would 
increase the numerical value of the constant, b, in (a) and would thus have the 
same effect on the value of Mp as a decrease in q. 
Let us assume that initially all cells have a threshold of g,, which is greater than qo, 
the value corresponding to Mp. Then the first time the region we are considering is 
stimulated at G, the resultant wave W, will only pass through the section HJ with 
the help of a mean EF excitation of (q, — qo). Suppose then that each time a cell 
between H and J becomes active its threshold q is reduced by a very small amount 
€ away from the value q, towards go. Then the second time the same stimulation 
is applied to G slightly less excitation, (q¢, — € — qo), is required from E inputs to 
enable W, to pass. In this way it becomes gradually easier for wave W, to pass 
from plane G to plane 7 where its arrival is registered by the activation of the 
corresponding cell. After the wave W, has passed N, times, the F excitation which 
will permit it to pass again will be (q¢; — Nie — qo). 
If a different stimulation (i.e. via a different group of cells selected independently 
of whether they were activated by W,) is applied to plane G, the resultant wave 
W, will in general encounter a large proportion, equal to (1 — Mo), of cells with a 
threshold of g, and a small proportion, Mo, with a threshold (q¢, — Nie). The mean 
value of q will thus be 

(qs — NieMp) , 


which will be hardly less than q,. For the wave W2 to pass with this value of q, the 
FE excitation must be raised to 


(ds — NieMo — qo) - 
Since M < 1 this will be considerably higher than the F excitation 
(gs — Nie — qo) 


required for wave W,. Thus if the EF excitation is set at a value just above the 
latter, W, will pass freely while W2 will not pass. The amount by which the E£ 
excitation then has to be raised in order for W2 to pass freely will be a measure of 
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Nj. 

In time, if W2 is passed frequently with assistance from the F input, the threshold 
of all the cells activated by it will decrease until, when N2 equals Nj, it will pass 
with no more F excitation than W,. Any other wave Wp initiated by activation of 
cells chosen randomly (i.e. without reference to past events) will still in general 
require an FE excitation of 


las — (Ni + No) - «Mol 


. [as — S2UV) - Mo] 


to assist its passage. Provided again that Mp is small, this will be considerably 
more than the excitation required by W, or W2 or any other wave which has passed 
many times. 

Each wave which is permitted to travel through the region thus, in effect, establishes 
a path for itself along which it can travel more easily (i.e. with less F’ excitation) 
in the future. Moreover, the ease with which it passes is a measure of the number 
of times it has travelled through. The effect has been discussed in relation to a 
change in threshold, g, but a similar effect would be produced if growth of the cells 
was promoted by use. It should be emphasized that the reduction in threshold 
with use need only be a very small one. The passage of one wave need only affect 
the cells it uses very slightly. 
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5. Properties of a Mass of Cells as 
an Integral Part of a More 
Complex Mechanism 


5.1. Learning behaviour 


In order to demonstrate fully the significance of the behaviour described in the last 
few sections it will be necessary to consider the reaction of the composite mass 
as an integral part of a more complex mechanism. It will be shown that, due to 
the presence of the mass of cells, this mechanism can exhibit learning behaviour. 
The mechanism has been kept as simple as possible, since the purpose of this 
paper is to investigate the properties of a mass of cells and not primarily those of 
mechanisms of which it may form a part. The composite region G, H, J, T will 
be considered as a whole again, as in section 4.5, complete with EF and J inputs 
within the section H, J (Figure 5.1). The individual cells in the section H, J will 
be assumed to possess one of the properties discussed in section 4.5, e.g. either 
reduction of threshold or growth with use, so that a wave which has traversed the 
region many times in the past will travel through more easily on a future occasion. 
The J input has deliberately been shown in a multiple form, each input having a 
localized effective area. 

This whole composite region will be incorporated in a more complex mechanism 
(Figure 5.2) with the following specific connexions between it and the rest of the 
mechanism. 


(i) It will be assumed that the complete mechanism has a means of discriminating 
an undesirable situation as shown by the output of certain sensory receptors 
(e.g. pain in a living organism). The output of this discriminator is connected 
to the J inputs in such a way that: 


a) A slightly undesirable situation only causes one or a few J inputs picked 
at random to operate for a period. 


b) A more undesirable situation or a continued undesirable situation oper- 
ates more J inputs in the same manner. 


c) A highly undesirable situation operates a very large number of J inputs. 


5. Properties of a Mass of Cells as an Integral Part of a More Complex Mechanism 


(ii) It will be assumed that the complete mechanism has a similar discriminator 
for satisfactory situations which can operate the E input or cause it to 
continue in operation. It is not proposed at present to go into the question 
of the form the discriminators might take, for it is easy to visualize a simple 
group of cells providing the required action. 


(iii) All the sensory receptors of the complete mechanism are connected to the 
input plane, G, of the complete region G, H, J, T in such a way that any 
stimulus pattern applied to the receptors causes a corresponding wave to be 
initiated. 


(iv) The cells in the terminal plane T are connected randomly to the various 
motor responses of the complete mechanism. Thus, when a cell or group of 
cells in the plane T’ become active, the corresponding motor action will take 
place in a deterministic manner. 


Incorporated in this way into a complete mechanism with sensory receptors and 
means for providing motor responses, the composite mass of cells is capable of 
showing learning behaviour. We have already seen (section 4.5) that a wave which 
has passed through the region unhindered many times will pass through again 
relatively easily. If, therefore, the complete mechanism of Figure 5.2 is placed in a 
familiar environment it will respond by motor action (or absence of it) in the same 
way as it has done previously. 

If the complete mechanism is placed in an unfamiliar environment then a wave will 
be initiated in the mass which does not correspond to any past wave which has 
travelled through. If there is sufficient EF input for the wave to reach the terminal 
plane, 7’, then some motor action will be initiated. But except for effects which 
will be discussed in section 5.2, section 5.3 and section 5.4, the point which is 
stimulated in the plane T is determined by chance. The motor action which results 
is therefore, with the same exceptions, determined merely by chance. 

Two possibilities must therefore be considered. 


(i) That the motor action leads to satisfactory results. 
(ii) That the motor action leads to an unsatisfactory result. 


If (i) is true, then the ” discriminator of satisfactory situations” will cause the motor 
action to be continued or repeated. The corresponding wave will travel through 
the composite mass many times and will eventually establish an easy path for 
itself. The previously unfamiliar environment will thus in time become a familiar 
environment and the response to it established and automatic. 

If (ii) is true, then the discriminator of unsatisfactory situations” will operate 
gradually more and more of the J inputs, until the propagation of the wave is 
affected sufficiently for the wave to be deflected to a different terminal point in the 
plane T’. The same process can occur again and again, and only when a satisfactory 
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Figure 5.1.: Composite mass with EF and J input 
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Figure 5.2.: Composite mass incorporated in a mechanism complete with sensory 
receptors and motor responses 
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result is obtained is the corresponding wave allowed to travel unhindered through 
the mass of cells and establish a path for itself. 

The mechanism just described accounts for both learning under deliberate tuition 
and learning by ”trial and error”. In learning under tuition it is the tutor who 
deliberately provides the ”satisfactory or unsatisfactory” situations in the form 
of reward or discouragement. In learning by ”trial and error” the reaction of the 
environment is classed as satisfactory or otherwise by the corresponding discrimi- 
nators. In either case the result is to establish a path for the wave through the 
cell mass to a point in the T plane which will produce a motor response leading to 
a satisfactory result. The complete mechanism thus has the ability to ” guide” a 
wave through the mass of cells to a suitable output point in the 7 plane and it is 
on this ability that the whole learning process depends. 

Trial and error learning is by its very nature wasteful of time and effort. It will, 
however, be shown in section 5.3 and section 5.4 that there are effects which in 
practice effect considerable economy in both by enabling only ”relatively likely” 
motor responses to be tried. 

A note will probably not be out of place here on the degree of organization which 
has been postulated in the mechanism shown in Figure 5.2. By making enough 
assumptions one can ”explain” anything, so it is desirable that a distinction should 
be made between assumptions made solely in order that the properties of a mass 
of cells may be demonstrated easily and assumptions which are an addition to 
the individual cell properties already assumed. It has already been remarked 
that the subdivision of the composite region into sections GH, HJ and JT serves 
the former purpose and that other shapes and arrangements would show similar 
properties. The addition of an input organ consisting of sensory receptors and an 
output organ with motor responses is essential if there is to be any discussion of the 
response of the cell mass to its environment. They are, in fact, its only means of 
communication with the outside world. The assumptions about the discriminators 
and their manner of connexion to EF and J inputs are the only basic additions to 
the original assumptions about the nature of the mass. These discriminators are an 
essential part of the mechanism as far as learning of this sort is concerned. It may 
be remarked that one could hardly have such a learning process unless something, 
somewhere within the complete mechanism, specified what had to be learned. For 
the reasons given in section 4.5 it is possible that one could dispense with either 
the E or the J input, replacing it by a modification of the other. In the same way 
two discriminators may be redundant in view of their complementary functions 
but have been retained in Figure 5.2 to avoid complexity of connexions. 

Even though the complete mechanism shown in Figure 5.2 has some degree of 
organization the multiple connexions between the various units are still assumed to 
be made in a random manner. The whole mechanism can therefore be very simply 
specified and is thus of the type which one would not be surprised to find in a 
self-reproductive living organism. 
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5.2. The propagation of successive waves in the mass 
and the formation of secondary waves 


It has been shown in section 4.3 that the amplitude M of a single wave propagat- 
ing through a mass of cells can be restored by a simple servo-mechanism to the 
value Mo, even though, owing to some statistical fluctuation in density of cells or 
connexions, it departs temporarily from this value. The same servo-mechanism 
will serve to restore the amplitude if some other influence disturbs it temporarily. 
It is important to note that if it takes the form postulated in section 4.3 the 
servo-mechanism will not act immediately. Section GH of the composite region 
discussed earlier consisted of a mass of cells with this form of servo control. The 
properties of the same kind of medium in the presence of more than one wave will 
now be considered. 


Propagation in a partly used medium with servo control of M 


As a wave passes through a mass of cells a proportion Mo of the cells are used up. 
It is proposed to consider the properties of the medium through which the wave 
has passed, during the period before the cells recover. If My < 1 the reduction in 
effective cell density will be small and the medium will still be capable of propagating 
waves. The residual effective cell density will be p- (1 — Mo) and the critical value 
Mp for a second wave passing through the medium will be correspondingly increased. 
Mo is approximately inversely proportional to \/p, so the increased value of Mo will 
be approximately tr expressed as a proportion of the new effective cell density 
p:(1— Mo). Expressed as a proportion of the original cell density p, the new value 


of Mp will be 
Mo 
M6 = ———_.- (1 -— Mo) = Mo: V1- Mp. 
0 = VMp ( 0) 0 0 
The number of cells becoming active per unit time in the original wave passing 
through the medium is given by Mofp. For the second wave passing in the path of 
the first the corresponding value is 


Mipi gf = 0k. 
(1 _ M)at 

If q is of the order of 10 and M is small, M)’p' is only very slightly above the 
value Mp for the original wave, i.e. the number of cells becoming active per unit 
time is only slightly affected by the reduction in density. Now, it is the quantity 
Mop which is monitored and controlled by the servo-mechanism controlling the 
amplitude of the wave. This mechanism will therefore work equally well on the 
second wave. 

It is of interest to note that further waves may continue to pass through the same 
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region before any of the cells used by the preceding waves have recovered. The 
second wave encountered a cell density of p- (1 — Mo). The third will encounter a 


density 
p-{1—Mo—Mo-V1—Mo} , 


the fourth, a density 


p- {1 — My — Mo: T= My — Mo- [1 — Mo — Mo- T= Mo] } ete. 


Neurons have the ability to recover their sensitivity after a period of time, and if 
cells are also assumed to have this property there will be no need for a continual 
increase of MZ to compensate for the decrease in effective cell density. There will 
be a temporary decrease in effective density immediately after the passage of a 
wave, and the exact length of the recovery period does not affect the nature of the 
encounter between two waves discussed below. 

A wave may be initiated in a partly used medium by the same means as the original 
wave was launched (see section 4.1). The initial stimulus D required is slightly 
increased in proportion to the increased value of Mj6"p’. Waves in a partly used 
medium may also arise in other ways which will now be considered. 


Two waves meeting 


If two waves approach each other from opposite directions, then in the region 
where they meet the effective value of M will be increased by the interaction of 
the activity of the two waves. If the servo-mechanism is of the type discussed in 
section 4.5 it will not act immediately, and for a very short period the value of 
will be more than doubled, because of the non-linear nature of propagation in the 
medium. 

This increased value of M will now make it possible for two waves to travel out 
from the region of the encounter, back along the tracks of the original waves, 
even though a proportion Mp of the cells in these tracks has been used already 
(see Figure 5.3). The initial value of M for these waves may be high but will 
soon be restored to approximately Mp by the servo action. It will appear from 
the form of the waves as though the two had merely passed each other, but in 
constitution both resultant waves will be a combination of the two incident waves. 
In a similar manner two waves crossing obliquely may continue in their original di- 
rection though the constitution of each will be modified to some extent by the other. 


Interaction at a boundary 
A resultant wave may also arise in a region through which a single incident wave has 


travelled as a result of the interaction between the incident wave and a boundary 
where there is a sudden change in property of the medium. Suppose, for example, 
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Figure 5.3.: Sketch to illustrate distribution of activity (full line) and used cells 
(broken line). a, before the encounter (incident waves); b, during the encounter; c, 
after the encounter (resultant waves) 


medium with 
high 1, 


medium with low M, 


Figure 5.4.: Interaction with a boundary. 1, initial wave; 2, resultant wave 
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B A 


travelling peak of activity high proportion of cells 
at intersection of A and B with decreased threshold 


Figure 5.5.: Interaction between two waves 


that p, ao or g are altered in some region which the wave encounters so that the 
critical value Mp is less than in the region through which the wave has been passing. 
M will be above the critical value in the new medium and, again assuming a time 
lag in the operation of the servo-mechanism, M will be subject to a temporary 
increase where the wave encounters the boundary. As with the encounter between 
two incident waves this will produce a resultant wave travelling back along the 
track of the incident wave. The incident wave may also, of course, continue in a 
forward direction (Figure 5.4). 

The last two subjects which have been considered, the reaction of the medium 
after encounter of two waves and the formation of a new wave at a boundary in 
the medium, bear surprising similarities to the behaviour of a wave in a medium 
obeying the normal linear wave equations. The importance lies in the presence of 
the high peak of activity in the region of their encounter. 


Modification of the medium—Storage of information—Regeneration of waves 


If the additional cell property of reduction of threshold with use is postulated, 
further interesting properties of the medium in the presence of more than one wave 
arise. This additional cell property, and the complementary one of cell growth 
being dependent on use, have been considered previously in section 4.5 in relation 
to a single wave travelling through a composite cell mass. 

It is perhaps easiest to discuss the effect of this property on two waves in relation 
to two waves crossing each other obliquely. Suppose A and B in Figure 5.5 indicate 
two wavefronts W4 and Wg which have on many occasions travelled across the 
region shown in the same time relationship. Then everywhere within the region 
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B A 


ne ne 
travelling peak of activity 
at intersection of A and B 


Figure 5.6.: Regeneration of a wave 


shown there will be cells which, because they have been used during the passage of 
the waves, will have correspondingly decreased their threshold. These cells will be 
uniformly distributed with a density Mp throughout the region except along the 
centre line Z where, due to the interaction between the waves, a very much greater 
proportion of cells will have been used and will have decreased their threshold. As a 
result the critical value Mo will be lowered all along the centre line L. The passage 
of one wave alone, e.g. W,4, will then produce a peak of activity where the wave 
intersects the line L, and if the local value of Mo has been reduced sufficiently the 
peak will regenerate a second wave Wy as it travels along the line L (Figure 5.6). 
The regenerated wave, Wp, although of the same form as Wz, will not have exactly 
the same constitution. The constitution will, however, be similar, since the majority 
of cells becoming active along the line L will after many simultaneous occurrences 
of W4 and Wg be the same whether W,4 and Wz are both present or W, only is 
present. 

By the same mechanism the passage of Wz alone may produce a wave W’, similar in 
constitution to and the same in form as W,4. There will also be a tendency for other 
waves to interact with the line Z in the same way. The product of this interaction 
will, however, be unlike W,4 and Wg, in that it will not have an established path 
through the mass of cells. It will therefore be subject to a very high attenuation. 
This tendency to form spurious waves will, however, be the limiting factor to the 
amount of information relating pairs of waves which may be stored in the form of 
lines of decreased threshold in a given volume of cells. 
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In the above discussion waves W,4 and Wg have been shown crossing obliquely 
because this facilitates demonstration of the regeneration of a wave. Under certain 
circumstances, however, it is possible for one single wave with two constituent 
components W, and Wz to modify the medium through which it travels so that 
on a later occasion the component W, occurring alone can regenerate the other 
component Wz and vice versa. 


5.3. The mass of cells as a link in conditioned 
response chains 


We are now in a position to compare the behaviour of the mass of cells with the 
class of behaviour known as the conditioned response. The essential basis of the 
conditioned response is that if some stimulus A always produces a response A and 
a second stimulus B repeatedly occurs in conjunction with A, then eventually the 
stimulus B occurring alone will tend to elicit the response A. 

Now it is easy to see how such behaviour may arise in the manner considered in 
section 5.2. Wave W, is initiated by a stimulus which may conveniently be called 
stimulus A. Similarly, stimulus B initiates wave Wz. If the two stimuli A and 
B have repeatedly occurred together then eventually stimulus B may indirectly 
initiate a wave W/, which is very similar to Wy. The more frequently Wy, has 
occurred, and W,4 and Wg have occurred in conjunction, the greater will be the 
similarity between W!‘, and W, and the greater will be the probability of W/, 
terminating at the same point or points in the terminal plane, 7’, as W, does. 
Thus the mass of cells will provide a conditioned response. The specific organization 
of the composite mass of cells within the more complex mechanism, and the use 
of EF and I cells postulated in section 5.1 are not necessary for the occurrence of 
conditioned responses. Conditioned responses are a form of behaviour inherent in 
the nature of the medium, i.e. a volume of interconnected cells having the ability 
to grow or decrease their threshold with use. If, however, this mass of cells is an 
integral part of some more complex mechanism of the form discussed in section 5.1 
the conditioned response will be subject to suppression or reinforcement according 
to whether it leads to an unsatisfactory or a satisfactory result. The combination of 
the conditioned response with the mechanism of section 5.1 is thus a means which 
enables the mass of cells to direct the waves travelling through it to a satisfactory 
conclusion with less waste of time and effort than is possible if pure trial and error 
methods are used in choosing tentative responses. 


5.4. Sequential regeneration of waves — Memory 


A very interesting form of behaviour arises if from cells in the plane J, or somewhere 
in its neighbourhood, connecting fibres are brought back to the input plane G. 
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These are designated R fibres in Figure 5.7, where for convenience of exposition 
the plane G is shown in two parts, Gint, where waves are initiated by impulses 
fed back through these fibres, and G.xt, where waves due to external stimuli are 
initiated. The connexions between J and G may be made in a random manner, i.e. 
the individual connexions need not be specified. 

With these R connexions present, the composite mass initially works in much the 
same way as before. Each wave initiated by external stimuli eventually establishes 
for itself a path to a point in the plane 7’ which will produce a motor response 
leading to a satisfactory result. But now each wave as it passes plane J causes 
a new wave, Wint., to be initiated from Gi,. This will combine with waves, e.g. 
Wext, initiated from G., by later external stimuli to produce a region of reduced 
threshold along the line LZ in the manner discussed in section 5.2. 


original wave 
continuing towards 7 


internal FR fibres 


Figure 5.7.: Modification of the mechanism of Figure 5.2 by the addition of 
internal FR fibres 


After the cell mass has been in use for some time there will be many regions of 
reduced threshold similar to L. Each will correspond to the relation between one 
set of stimuli and a set which has in the past followed it closely. Within these 
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regions of reduced threshold is stored all the information required for the internal 
regeneration of a long sequence of past events. 

To start the composite mass regenerating past events, it is only necessary to initiate 
a wave of external stimulation at plane G and then remove further external stimuli 
which would interfere with the process. The wave then travelling through the 
mass will be carried back by the R fibres to form a corresponding wave W;,,.. If 
the general threshold is sufficiently low, Wins. will then reconstitute a wave, WJ, , 
corresponding to the stimulus which in the past had followed it. Sometimes different 
events will in the past have followed a given set of stimuli on different occasions. 
Then, in general, it will be the wave corresponding to the most probable following 
event which is regenerated. 

The regenerated wave W{,, will in its turn be returned by the R fibres to form a 
second wave W,,, , which in turn can regenerate a second, most probable, following 


int.? 
wave Wv,. In this way a whole series of waves follow each other through the 
region exactly as they would do if the corresponding sequence of most probable 
events was actually occurring in the outside world. This behaviour bears a striking 
resemblance to the recall of a sequence of memories in the form of a train of thought. 
The latter can occur without the accompaniment of any muscular action, and it 
need hardly be pointed out that a temporary increase in threshold throughout the 
section JT’ would prevent motor responses accompanying the sequence of waves. 
The survival value of this form of behaviour in a living organism is obvious. It 
allows the organism to explore some way ahead and discover the most probable 
results of a contemplated action and to decide whether or not to take that action 
according to the satisfactory or unsatisfactory nature of these anticipated results. 
It is not difficult to visualize modifications which could be made to the mechanism 
of Figure 5.2 to allow it to make use of the ability of the composite mass to explore 
a succession of most probable events. The modified mechanism would then pick a 
motor action shown by the sequence of most probable events as likely to lead to a 
satisfactory result. A satisfactory result is of course a result recognized as such by 
the ’ discriminator of satisfactory situations”. 
The process which has just been discussed is in effect an extension of the simple 
conditioned response. It provides an even more powerful means of choosing a 
likely response to a given situation and thus provides an even greater economy 
of time and effort as compared with the pure trial and error methods discussed 
in section 5.1. Refinements in the simple mechanism would enable the sequential 
wave regenerating behaviour to be switched in when necessary and would enable 
it to be stopped when a satisfactory probable result has been found. These are, 
however, beyond the scope of the present paper. 
It is important to note that if the mass of cells is in the shape of an annulus, or 
forms the surface of a sphere or other closed surface, or if reflexion takes place in 
the plane J, this sequential memory effect can take place without any additional R 
fibres. 
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The comparisons that have been made in the past between the properties of com- 
puting machines and of living organisms are interesting when made in relation to 
abstract fundamental concepts, but less productive when details are considered. 
This is because, in the detailed design of most large computing machines, compo- 
nents are connected together exactly according to some specification, and have a 
precise function in relation to all other components. This specific organization in a 
computer contrasts with the apparently very large random factor in the intercon- 
nexions between neurons in many parts of the cortex. 

The aim of this paper has been to show that some of the basic forms of behaviour of 
living organisms can be simulated by a mass of simple units without the necessity 
of postulating a large degree of specific organization of these units. Care has been 
taken to keep the degree of organization to a minimum in discussing the behaviour 
of a mass of cells in relation to a complete mechanism. It should be emphasized 
again that the representation of a mass of cells in the form of a composite mass 
subdivided into several sections was mainly adopted as an aid to demonstration 
of the properties of the medium. The properties are, however, inherent in the 
proximity of large numbers of such cells and would be present in various shapes 
and arrangements of masses of cells. The inputs from sensory receptors and the 
motor response outputs might be scattered over the surface or within the volume 
of the mass. Waves might not be confined to one general direction of propagation 
but might well travel in all directions. One would therefore not necessarily expect 
to find anatomical structure closely resembling the composite mass of cells shown 
diagrammatically in this paper, within an organism making use of the properties 
which have been discussed. Moreover, there could be considerable variation from 
point to point in cortical structure without invalidating the comparison between 
cell and neuron masses. A living organism probably would have a large number 
of hereditary responses upon which conditioned responses could be built. The 
connexions from the sensory receptors to the discriminators of section 5.1 are in 
fact ” built-in” response paths which are assumed to be present initially. 

The three effects, trial and error learning, conditioned responses, and the regenera- 
tion of past events, have been discussed as if they took place in one mass of cells. 
This is not essential, and it might very well happen in an organism with a number 
of well-differentiated types of sensory receptor (e.g. man) that some of the effects 
were dispersed. Some might be produced in cell masses attached directly to the 
sensory receptors and some in other masses of cells concerned more with secondary 
relationships. It might well be that the discriminators of section 5.1, instead of 
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being the simple mechanisms envisaged there, are themselves masses of cells the 
outputs of which are connected, not to motor responses, but to groups of E and I 
cells, and serve the purpose of controlling the distribution of attention between the 
various senses or between various groups of receptors within one sense. 

It is thought that further examination of all three effects would be profitable as only 
a very simplified, formalized state of affairs has been considered. Mathematical 
investigation of the properties described above would be desirable and should lead 
to interesting results. It is hoped to follow this up in due course. It would be 
particularly interesting to calculate the information storing and handling capacity 
of a limited mass of cells in terms of the number of cells present, and to make 
comparisons with living organisms. 

The possibilities of continuous random activity, vortex effects and other reverbera- 
tory systems within a mass of cells providing, among other things, a short-term 
memory effect, have been omitted in the above discussion. It is proposed to consider 
these in detail in a further paper. 

It should be noted that there is no particular significance in the exact form of the 
wave travelling through the medium. The form 


M6 
2 - cosh? {B- (t — =)} 


|x| 


arises when €(z) = b-e “. Minor variations in the form of €(#), which do not 
materially alter the mean density of connexions, will cause corresponding changes 
in waveform without affecting anything that has been discussed in this paper. 
Major changes in waveform might be produced by the presence of certain forms of 
amplitude controlling servo-mechanism. Under these circumstances the surge of 
activity could even become reduced to a mere diffuse spread of activity. Even so, 
the learning, conditioned response and memory effects discussed in this paper might 
well be unaffected. The important point about the waves which travel through 
the medium which has been considered is the non-linear, co-operative nature 
of propagation. Consequently, even slight changes in almost any cell property, 
provided they are brought about by use and facilitate activity, will cause a selective 
action of the medium on waves propagating through it and result in the types of 
behaviour which have been dealt with in this paper. The following are examples: 


(i) Decrease in threshold with use. 

(ii) Increase of strength of activity with use. 
(iii) Growth of dendrite structure with use. 
(iv) Growth of axon structure with use. 


(v) Formation of, or increased effectiveness of, synapses with use. 
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(vi) Formation of, or increased effectiveness of, synapses when the two cells 
concerned are activated simultaneously. 


If the propagation of waves in the medium were linear, the choice of possibilities 
would be limited to the last of these, and a much greater change would be required. 
It would therefore be of interest to know for certain whether any cell property does 
alter with use and if so how much. Another important question is ”can excitation 
only pass from axon to dendrite or can it pass in both directions?” In the latter 
case, regeneration of waves in the manner discussed in section 5.2 would occur more 
readily than in the former. In this paper, greater importance has been attached 
to the propagation of wave motion, in relation to long-term memory, than to 
continuous random activity. This is because of the supposition that the threshold 
of neurons may be considerably higher than unity, and continuous random activity 
is consequently of an unstable nature. If excitation could pass in both directions, 
or if long-term memory was dependent on the sixth property listed above, then 
permanent memory storage could come about without the threshold q being greater 
than unity. There need then be no question of instability, and continuous random 
activity could be associated with long-term memory. It is thus necessary to know 
the order of magnitude of the threshold of neurons, and to discover the answers 
to these allied questions, if we are to progress further with even a qualitative 
description of the behaviour of a mass of such units. 


Relation to other papers 


Certain writers (McCulloch & Pitts [11]; Ashby [2]; Cragg & Temperley [6]) have 
considered the activity of sets or groups of neurons from the rather detached point of 
view of relation to logic, homeostasis, co-operative phenomena, domain theory, etc. 
In this paper the aim has been to consider in more detail the forms of activity which 
could exist in a particular type of cell structure and the behaviour which might be 
expected to arise as a result of this activity. The treatment is therefore very much 
less general but allows slightly closer comparison with biological investigations. 
That the correspondence cannot be closer still is partly due to the lack of data on 
the properties of neurons and on the structure of the cortex. Perhaps the most 
important cell property affecting the sort of behaviour which has been discussed 
is the one about which there is least published information. This is the threshold 
effect which is primarily responsible for preserving the form of the waves of activity, 
and is also responsible for the non-linear nature of propagation and may play an 
important part in the permanent storage of information by individual cells. 

Other writers (Rapoport [12], [13]; Anderson & Rapoport [1]; Shimbel [14], [15]) 
appear to have realized the necessity for statistical investigation of the behaviour 
of neurons, but instead of considering a spatially distributed mass of cells have 
restricted attention to small sets of two or three, or groups (ganglia) of neurons. As 
a result their conclusions only apply to such isolated groups of neurons. This leaves 
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it as a matter of conjecture how a large volume of cells, such as are found in the 
cortex, would interact. Moreover, there are other disadvantages in only considering 
the interaction between individual neurons. For instance, in the paper which 
is of principal interest here, Shimbel [14] has to assume, without any empirical 
support, ”that the threshold of a neuron will be lowered if a super-threshold and 
a sub-threshold stimulus impinge on it in sufficiently close temporal contiguity” . 
The present paper shows that it is quite sufficient for the threshold simply to 
decrease with use or for any other equivalent change to take place (see (item (i)) 
to (item (iv)) above). Then again, Shimbel’s treatment over-emphasizes the 
seriousness of redundant conditioning. In a large, spatially distributed mass of cells 
a conditioned response is the result of interaction of a large number of neurons 
over a wide region. A response is only produced if the reaction from every part of 
this region is confirmatory, i.e. if the response is a true conditioned response; any 
other response is, relatively speaking, highly attenuated. 

The recent work of Sholl ({16], [17]) has drawn attention to the importance of the 
decrease in connective fibre density with distance from a neuron. It is to exploit 
these new data that the present paper has been written. In doing this the aim has 
been to demonstrate the basic properties of a medium comprising a mass of cells 
having properties as nearly as possible similar to the known properties of actual 
neurons. By considering the mass as a whole, some of the difficulties encountered 
by others have been avoided. This method of treatment also shows the importance 
of the unsaturated form of wave and the necessity for some means of maintaining 
this form of activity. The comparison of cell masses with actual cortical structure is 
not invalidated by the fact that the properties of the latter medium vary somewhat 
from place to place. This variation, particularly in respect of axon structure, is a 
fact which has yet to be investigated and may prove of considerable importance. By 
comparison with other papers on the subject the conditioned response is presented 
in a slightly different light, i.e. as a factor which reduces the waste inherent in trial 
and error learning. 

The earlier methods of treatment failed to bring out clearly the non-linear nature 
of propagation consequent on a threshold greater than unity, the very selective 
action of a cortical mass on the activity passing through it, and the fact that a 
very minute change of some cell property, each time the cell is used, is sufficient 
to produce a ”memory trace”. The stress, in the foregoing discussion, on waves 
of activity is interesting in view of recent electroencephalograph investigations 
with several spatially distributed pick-up probes (Chang [5]; Burns [4]; Walter & 
Shipton [22]; Walter [21]; Lilly [9]). 

The structure considered in this paper bears a particularly interesting relation to 
the probability machine discussed by Uttley (Sholl & Uttley [18]; Uttley [19]). The 
machine mentioned in the latter paper stored information about the frequencies 
of past occurrences in individual units. The inference contained in the present 
paper is that the practical counterpart of one of these storage units may be a large 
number of cells each of which serves as a common storage point for information 
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about large numbers of occurrences. The ambiguity which this might cause is 
avoided by the fact that information about a particular type of occurrence is stored 
in a very large number of such units in such a way that it may be extracted for 
use when necessary. There is thus a sort of multiple diversity effect which would 
readily account for the fact that damage to a limited region of the cortex does not 
have any marked effect on the operation of the whole storage system. 


53 


f. Acknowledgements 


The author wishes to thank Dr A. M. Uttley, Sir Bryan Matthews and Mr D. A. 
Sholl, the former for suggesting the preparation of this paper and all three for 
encouragement and advice. Thanks are also due to the referees for many helpful 
suggestions. Acknowledgement is made to the Chief Scientist, the Ministry of 
Supply, and the Controller of H.M. Stationery Office for permission to publish this 
paper. 


eo 


Bibliography 


N. Anderson and A. Rapoport. A note on facilitation and threshold phenomena. 
The Bulletin of Mathematical Biophysics, 13(1):47—49, 1951. 


W. R. Ashby. The stability of a randomly assembled nerve-network. Elec- 
troencephalography and Clinical Neurophysiology, 2(1-4):471—482, 1950. 


R. L. Beurle. Technical report, Radar Research Establishment, 1954. Memo- 
randum No. 1042. 


B. D. Burns. Some properties of isolated cerebral cortex in the unanaesthetized 
cat. The Journal of Physiology, 112(1-2):156-175, 1951. 


H. T. Chang. Dendritic potential of cortical neurons produced by direct 
electrical stimulation of the cerebral cortex. Journal of Neurophysiology, 
14(1):1-21, 1951. 


B. G. Cragg and H. N. V. Temperley. The organisation of neurones: A 
co-operative analogy. Electroencephalography and Clinical Neurophysiology, 
6(Pages A1-A10):85-92, 1954. 


J. Eccles. The Neurophysiological Basis of Mind. Oxford Clarenden Press, 1 
edition, 1953. 


J. C. Eccles and A. K. McIntyre. Plasticity of Mammalian Monosynaptic 
Reflexes. Nature, 167(4247):466—468, 1951. 


John C. Lilly. Instantaneous Relations Between the Activities of Closely Spaced 
Zones on the Cerebral Cortex. American Journal of Physiology, 176(3):493-504, 
1954. 


R. Lorente de N6é. Cerebral cortex: Architecture, intracortical connections, 
motor projections. In J. F. Fulton, editor, Physiology of the Nervous System, 
Outlines of Physiology Series. Oxford University Press, 3 edition, 1949. 


W. S. McCulloch and W. Pitts. A logical calculus of the ideas immanent 
in nervous activity. The Bulletin of Mathematical Biophysics, 5(4):115-133, 
1943. 


Bibliography 


[12] 


[13] 


[14] 


15 


16 


17 


18 


19 


A. Rapoport. Contribution to the probabilistic theory of neural nets: I. 
Randomization of refractory periods and of stimulus intervals. The Bulletin 
of Mathematical Biophysics, 12(2):109-121, 1950. 


A. Rapoport. Nets with distance bias. The Bulletin of Mathematical Biophysics, 
13(2):85-91, 1951. 


A. Shimbel. Contributions to the mathematical biophysics of the central 
nervous system with special reference to learning. The Bulletin of Mathematical 
Biophysics, 12(3):241-275, 1950. 


A. Shimbel. A note on the problem of cycles in random nets. The Bulletin of 
Mathematical Biophysics, 13(4):319-321, 1951. 


D. A. Sholl. Dendritic organization in the neurons of the visual and motor 
cortices of the cat. Journal of Anatomy, 87(4):387—406, 1953. 


D. A. Sholl. The organization of the visual cortex in the cat. Journal of 
Anatomy, 89(1):33-46, 1955. 


D. A. Sholl and A. M. Uttley. Pattern Discrimination and the Visual Cortex. 
Nature, 171(4348):387-388, 1953. 


A. M. Uttley. Temporal and spatial patterns in a conditional probability 
machine. In C. E. Shannon and J. McCarthy, editors, Automata Studies, 
Annals of Mathematics Studies, pages 277-285. Princeton University Press, 
1956. 


A. M. Uttley and B. H. C. Matthews. The Probability of Neural Connexions. 
Proceedings of the Royal Society of London. Series B - Biological Sciences, 
144(915):229-240, 1955. 


W. G. Walter. Dissection, abstraction et persistance des images sensorielles 
dans le cerveau humain. Révue Neurologique, 87(2):155-161, 1952. 


W. G. Walter and H. W. Shipton. A new toposcopic display system. Elec- 
troencephalography and Clinical Neurophysiology, 3(3):281-292, 1951. 


56 


Additional symbols used in appendix 


k; The constant obtained by integrating €(x) from 
—oo to +00 
m A constant, the ratio of ® to F in Appendix B 


Piq-1) The term (q — 1) in the POISSON series 


Z A correcting factor for Piq—1), so that it applies 
to the distribution of impulses in sensitive cells 


ot A very short interval of time 


This Appendix covers, in analytical form, the same ground as chapter 3 of the 
paper. The analysis will be based on the two equations: 


+00 
Mean rate of arrival of impulses = ‘ F(X,t)-€(a@ —X) dx (1) 
and 
me 0 -++oo 
n= | / F(X,T) -&(x —X)-x(t -T) dX dT. (II) 


Continuous random activity will be dealt with first, as it affords a simple illustration 
of the application of the statistical methods outlined at the beginning of chapter 3. 


A. Continuous random activity 


We wish to consider what would happen if initially, throughout a volume of cells, 
the activity F was constant and independent of x, and to find the conditions under 
which the activity would be self-maintaining. 

As the activity is assumed to be constant throughout, the convolution of Equation I, 
giving the mean rate of arrival of impulses, simplifies to 


Ff ga)ae, 


(oe) 


which will be written F’k, i.e. 
+00 
Pekar. | tala ales 


If €(x) has the form given in section 2.3, then the constant k will be 2bap. 
The adoption of a rectangular function of duration s for y(t) simplifies Equation IJ, 
giving the mean value of the total integrated excitation 


N = Fks. 


A. Continuous random activity 


There will be a Poisson distribution! of actual numbers of impulses so that the 
proportion of cells with a total excitation of (q — 1) will be 


Po-1y =e % 


It may be shown, by a statistical examination of the distribution of numbers of 
impulses in sensitive cells and used cells, that if s is not much larger than 7, the 
proportion P(g—1) will be substantially independent of whether the cells are sensitive 
or used. If s >> 7, the above expression for P(g_1) must be multiplied by a correcting 
factor as N approaches q, so that it applies to sensitive cells. The proportion of 
cells which have a total excitation of (q— 1) and are also sensitive will then be 


Re Pgs). 


These are the cells which are ready to be triggered into activity by the arrival of 
one further impulse. The proportion of these cells which actually do receive an 
impulse during a very small period ot, at a time ft, will be 


F(t) -k-ét. 


! Definition: 

Probability mass function 

A discrete random variable X is said to have a Poisson distribution, with parameter \ > 0, if it 
has a probability mass function given by: 


dM 
f(s) = Px(X=k) =e. F, 
where k is the number of occurrences k = 0,1,2,..., e is Euler’s number = 2.71828... and ! is 


the factorial function. The positive real number \ is equal to the expected value of X and also 
to its variance: \ = E(X) = Var(X). The Poisson distribution can be applied to systems with a 
large number of possible events, each of which is rare. The number of such events that occur 
during a fixed time interval is, under the right circumstances, a random number with a Poisson 
distribution. 

Assumptions and validity: 

The Poisson distribution is an appropriate model if the following assumptions are true: 


1. k is the number of times an event occurs in an interval and k can take values 0,1, 2,... 


2. The occurrence of one event does not affect the probability that a second event will occur. 
That is, events occur independently. 


3. The average rate at which events occur is independent of any occurrences. For simplicity, 
this is usually assumed to be constant, but may in practice vary with time. 


4. Two events cannot occur at exactly the same instant; instead, at each very small sub- 
interval, either exactly one event occurs, or no event occurs. 


If these conditions are true, then k is a Poisson random variable, and the distribution of k is a 
Poisson distribution. 


59 


A. Continuous random activity 


The proportion of cells receiving more than one impulse will be negligible, provided 
dt is very small. Thus, the proportion of cells which are sensitive and also fulfil 
the condition of attaining the threshold g during a period dt, and are therefore 
triggered off during that period, will be 


Be Peay eit) “hot. 


After an interval equal to the cell operating time 7, these cells will become active. 
The rate at which cells become active will then be 


F(t+7)=R- Pq: Fk. 


The factor Piq-1) is proportional to F“~), so that if F(t) is large, F(t +7) will be 
greater than F'(t), and the activity will thus increase during each successive period 
of r. If F(t) is small, F(t +7) will be less than F(t) and the converse will happen. 
There are two conditions for the activity to be self-maintaining at a constant level. 
The first is that F(t +7) shall be equal to F'(t), i.e. that 


R- Poy k=1. 


The second condition is that the rate at which used cells recover should equal the 
rate at which sensitive cells become active, i.e. that 


OR pa al tps 


where r is the recovery period. If the cells did not recover after a period they would 
of course all be used up in a short burst of activity and no continuous random 
activity could exist. 

From these two relationships 


Peyolalr) k=. 
This may be rewritten in terms of F’ks 


gate, ERS. (eke: ©) =" 

(q—1)! S 

It is of interest to insert approximate values of k and = for actual neurons in this 
equation. The value of k corresponding to Sholl’s data is 2ba9, and may range in 
value from 60 for average neurons, to 420 for neurons with long axons, in accordance 
with the range of possible values of b. If we take k = 60, g = 6 and = = 25 as in 
section 2.3, then the left-hand side of the equation is maximum when F'ks, the 
mean integrated excitation, has the value 1.8. The left-hand side is then equal to 
0.39 so that the equation cannot be solved. If, however, gq is 5 or less, a value of 
Fks can be found which will satisfy the equation so that uniformly distributed 
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A. Continuous random activity 


continuous random activity may occur. 

Thus it would appear that a block of cells having these properties cannot support 
uniform continuous random activity if the threshold, q, is above 5. This is because 
of the non-linear nature of the activity. Below a certain minimum amplitude, 
activity is incapable of sustaining itself. If g is above 5 this minimum amplitude is 
so large that the cells become used at a greater rate than they recover. The activity 
thus rapidly ” burns itself out” by using up all the sensitive cells and thus cannot be 
continuous. For higher values of q, only activity with some form of ” organization” 
can continue to exist, an activity which, having used a proportion of the cells in 
one region ”moves on” to another region where sufficient sensitive cells remain, 
perhaps to return when the used cells recover. The activity will then be a function 
of position and time. 

It should be noted that if g has the value 5 the state of uniform activity will be 
an unstable state, and any small statistical fluctuation in F' will start a rapid rise 
or fall away from the equilibrium value of F’. Thus, though uniform activity may 
be possible, activity with some form of spatial and temporal ” organization” will 
always be favoured if q is high. 

If instead of k = 60, we take the value k = 420 corresponding to neurons with 
long axons, then q can be as great as 10, the value mentioned in section 2.2, 
without making a solution of the equation impossible. The remarks regarding the 
instability of continuous uniform activity apply with even more force for higher 
values of g, and activity with some form of spatial and temporal organization is 
correspondingly favoured. It is proposed to consider one such form of organized 
activity, the propagation of a plane wave of activity through a volume of cells, as 
this will serve to illustrate the nature of the behaviour of the medium when q is of 
the order of 10. 
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B. Plane wave of activity 


We shall consider the possibility of a plane wave propagating in the direction 
of the z-axis. The parameters F' and R are now both functions of position and 
time. If a wave of activity has reached a given point on the z-axis (Figure 3.1b), 
then the region through which it has just passed will contain a high proportion 
of used” cells. The region on the other side of the peak of activity will, on the 
contrary, contain a relatively large proportion of ”sensitive” cells (Figure 3.1a, 
curve ii). This asymmetry means that the region in front of the peak of activity is 
better able to support further activity. Thus, although excitation travels out in all 
directions from the peak of activity (Figure 3.1c), a greater number of new cells 
is excited to activity ahead of the peak than in the region through which it has 
passed (Figure 3.1d). This is the mechanism by which the advance of the wave is 
maintained. Propagation is very different from that of the more familiar types of 
wave motion. One might better describe the disturbance as a ’surge” of activity 
to emphasize its transient nature. It is possible to construct a model to simulate 
this type of propagation. This has been done by making use of a high-speed digital 
computer, but it is more convenient if we can have an analytical representation of 
the nature of propagation. Owing to the non-linear nature of the medium, which 
is especially pronounced when q is high, one cannot represent propagation by the 
differential equations that apply to waves travelling through linear media. For this 
reason it is difficult to obtain a solution in general terms. What has been done is 
to obtain a differential equation which may be solved if a certain assumption is 
made, and to show that this assumption is in accord with the existing data on the 
connectivity between actual neurons. The differential equation will be based on 
Equation I and Equation II. 

In considering the possibility of a plane wave of activity propagating along the 
x-axis, we may take it that activity is uniform throughout each plane perpendicular 
to this axis. F(x, y,z,t) may thus be written F'(z,t). 

The convolution of Equation I 


[- F(X,t) -€(a — X) dX 


(oe) 


will therefore again give the mean rate of arrival of impulses at cells in any 
plane, x = const., and the convolution of Equation II will give N. If it were 
not for a correcting factor allowing for the slight difference in the distribution of 
impulses according to whether cells are sensitive or used, we should have a Poisson 


B. Plane wave of activity 


distribution of numbers of impulses among sensitive cells. As it is, we must apply 
a correcting factor which we may denote by Z, giving 
arla-)) 
we le 


Pyay= Zee" “@= DL 


The proportion of sensitive cells reaching the threshold q during an interval 6¢ will 
be vg 
Pon: f F(X,a)-€(a@ — X)dXot. 


To avoid further consideration of these functions at the moment, the proportion of 
sensitive cells which reach the threshold in an interval d¢ will be written 


O{F(a,t), E(x), x(é)f ot, 


or, simply 

Dot. 
It should be noted that, like the activity F’, the function ©® is a function of both x 
and t (see Figure 3.1). 
The rate at which cells which are sensitive reach the threshold, expressed as a 
proportion of the total cell density, is 


R-®. 


These cells will become active after a time 7, and the rate at which cells become 
active will then also be 
R-O, 


F(a,t+rT)=R-O. 


Differential equation for plane wave 


Now, for a given value of x the change in rate at which cells become active during 
the operating time T, i.e. unit time, will be 


F(z,t+7)-—F(z,t)h=R-O-F, 


dF 

—=R-O-F. Bak 

a (B.1) 
Each time a cell becomes active the number of sensitive cells is reduced by one so 
that 


=(R) =—F (B.2) 
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B. Plane wave of activity 


and 2 or 
dp (2) == ae (B.3) 


From Equation I, Equation I] and Equation B.1 it follows that 
d? ® d 
—(R)=4,R-—=-1>—(R 
a= {RB} He 

and hence 


d2 


glk) + {1— RZ) SR) =o. (B.4) 


Fy dt 


Solution to differential equation for ® =m. F 


In Equation B.4 the distribution of R is expressed in terms of time differentials. 
The fact that differentials with respect to x do not appear as such in this equation 
is misleading. In fact, this equation also contains space differentials within the 
ratio 2. Now, the spatial distribution of F' is the spatial distribution of active 
cells (Figure 3.1b). These cells spread excitation among their neighbours and, as 
a result, some of these neighbours are excited above the threshold gq. The spatial 
distribution of ® (Figure 3.1c) represents the spatial distribution of these latter 
cells. It is not surprising that there is a particular form of €(x) for which the two 
spatial distributions are the same, i.e. for which 2 is a constant. What is perhaps 
more surprising is the correspondence between this form of €(a) and the one which 
has been derived from Sholl’s empirical data (see section 2.3). This fact leads 
to interesting results. For this reason, the solution of Equation B.4 when © is a 


F 
constant, m, will be investigated. 


If 6 = m- F,, Equation B.2 becomes 


T (A+ 0-Rk m)“(R) oie (B.5) 
which has a solution 
Pawo eS. (B.6) 
mm 
and substituting this in Equation II gives 
b= 2 s (B.7) 


m cosh? {8 - (t — to)} 


If all cells are in the sensitive” condition initially, we have a boundary condition 
R=1 when t = —ov, and if a proportion M of cells is used during the passage of 
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B. Plane wave of activity 


the wave, R = (1— M) when t = co. Thus 


(m — 1) al ua 48 2: 


ols. <p 
2 m m 


Therefore 
MB 


cosh {B- (F—t)} 
The parameter M may conveniently be called the amplitude of the disturbance, 
and the constant 6 determines the rate of rise and fall of activity. 
The purpose of the present calculation is to show whether a plane wave of activity 
can travel through the medium we are investigating. If ® = m- F’, as we have 
assumed above, then for any particular value of x we have a pulse of activity the 
form of which is given by Equation B.8. Is it possible for this pulse of activity to 
propagate forward through the medium in the x direction? To test this hypothesis 
we must put to) = ¢, + = in the above expression for x, and then check whether the 
resultant travelling wave represented by 


(B.8) 


= Mp6 
* cosh? {3 - (¢-t - z)\ 


is consistent with the relation ® = m- F’ from which we started. What has in fact 
been done (see Appendix C) is to find the form of €(a) which makes the waveform 
of Equation B.9 consistent with 6 = m- F’. If €(x) has the appropriate form, the 
wave, once launched, should continue to propagate without alteration or increase 
in amplitude. 

We could of course equally well test the hypothesis that the medium can support 
a backward-travelling wave. To do this we should have to put ty) = t; — =, and 
check the consistency of the result with 6 = m- F’. However, as the medium has 
no directional properties it will be sufficient merely to show that a wave can travel 
in the forward direction. All that will be said applies equally to a wave travelling 
in the opposite sense. By suitable choice of time origin, t; may be omitted, giving 


(B.9) 


t= 5 sa ; (B.10) 
cosh {B- (é- z)\ 

It should be noted that the basic differential Equation B.4 is non-linear. Therefore 
we cannot put fo = ¢; + < and to = t; — = to give two co-existent solutions. A wave 
of the form given by Equation B.8 may either travel from left to right or from right 
to left, but not both together. If two waves approach each other, then in the region 
where they meet we cannot expect them to continue to propagate independently. 
What happens under these circumstances has been considered qualitatively in 
section 5.2 of this paper. 
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C. Requisite form for €(x) — wave of 
small amplitude 


Because F' is now a variable dependent on x as well as t, the evaluation of the 
function ©, for any given form of €(x), involves numerical integration of the 
convolution of Equation IT: 


Na ff FX1)-e@-X)-xt-T)axar, 


As this numerical integration is tedious the calculation will not be reproduced here. 
The details have already been outlined elsewhere (Beurle [3]). The result shows 
that, provided the amplitude of the wave is small (MV « 1) for ”q” of the order 
of 10, the form of €(x) which satisfies the relationship ® = m- F is very close to 


|x| 
b-e «. Thus, if €(x) is of this form and the constant b of the right magnitude, the 
simplified form of the differential equation applies, and its solution, Equation B.10, 
M 
i 5 p 
2- cosh {B- (é- z)\ 


defines the form of a wave that will be propagated through the medium without 
attenuation or gain. 


|| 


It will be noted that the expression b-e % coincides with that quoted earlier as 
an estimate of €(x) from empirical data. The requisite magnitude for b may be 
derived by performing the integration mentioned above. The result is to relate b to 
the other quantities involved, according to the equation: 


, (m—1)? _ agb \ 4 
(0.57) sg ET (g-1)!= (ass. 


The constant, 0.57, arises in the process of integration. It may also be shown that 


v _ 2ao 

ee ag 
The wave velocity may thus be calculated if all the quantities are known accurately. 
However, as noted in section 2.3 the value of the empirical constant b depends on 
several factors which are not known accurately at present. For this reason one can 


C. Requisite form for (a) — wave of small amplitude 


only make a very rough estimate of velocity. If one takes the range of values of b 
given in section 2.3 the velocity may range from a few millimetres per second for 
waves of small amplitude to several hundred for saturated waves. 

There is thus a reciprocal relationship between the amplitude of the wave and 
the constant b. If the density of connexions, represented by b, is increased, then 
the critical amplitude of a wave which will satisfy the relationship ® = m- F is 
decreased and vice versa. The width of the wave, given by B depends only on ao 
and q. If there is a departure from the above conditions regarding the amplitude 
of the wave and the value of €(x), the nature of propagation is modified. 


Waves of large amplitude 


If 6 = m- F holds, but the amplitude of the wave is not small, i.e. if MW is not 
very much smaller than unity, then at the peak of the wave the mean integrated 
excitation N will be large. For a given form of €(x) this is accompanied by a slight 
broadening of the waveform. Examples are shown in Figure 3.2 for various peak 
values of NV. For comparison, the waveform of Equation B.10, derived directly from 
the differential equation for waves of small amplitude, is also given. 


Dependence on €(x) 

The form €(x) = b-e- % was an estimate of the statistical distribution of connexions 
made from rather incomplete empirical data. The form of €(x) may differ from 
this, and any estimate of the value of the constant b must at present be regarded as 
indicating its order of magnitude only. The exact shape of the €(x) characteristic 
is relatively unimportant in relation to the rest of this paper, as it only affects the 
waveform of the propagated activity. It is the density of connexions, dependent on 
the constants ag and q, and its relation to the integration time s and the threshold 
q, which primarily decides whether waves of any given amplitude can propagate 
through the medium. 
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D. Departure from the relationship 
O=m-Ff 


So far, only waves for which the relationship ® = m- F' holds have been discussed. 
When ® = m- F, the amplitude of the wave is at a critical value such that the 
excitation it produces just maintains the level of activity constant. This critical 
value of M will be called Mo. If the wave amplitude is less than the critical value 
Mo, the excitation produced by the activity is insufficient to maintain that level of 
activity, and the wave is attenuated progressively more and more rapidly as the 
amplitude drops away from the critical value (Figure 3.3, curves a and b). The 
waveform, however, being largely dependent on the form of €(a) is not changed 
greatly. 

If the initial amplitude of the wave is above Mo, then the excitation produced is 
more than necessary to maintain the activity and there is a consequent progressively 
more rapid increase in amplitude. Eventually the wave saturates” when it uses 
all the cells in the medium through which it passes and cannot increase further in 
amplitude (Figure 3.3, curves c, d and e). 


